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(54) Systems and methods for processing audio or video effects 



(57) A system (10) for processing an input signal 
(12) can automatically apply a plurality of effects (22) 
thereto in a user-defined manner The dynamics of the 
input signal (12) are analyzed (18,20) so as to generate 



a plurality of signal characteristics. Each signal charac- 
teristic is processed through a plurality of effects (22) in 
a manner controlled by the user so as to be routed (24) 
automatically to such of the effects (22) in the plurality 
of effects as the user defines. 
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Description 

[0001] The present invention relates generally to sig- 
nal processing and, more particularly, to effects 
processing systems and methods capable of process- 
ing a signal which is analyzed to generate a plurality of 
signal characteristics, so as to automatically apply a plu- 
rality of effects to each of the characteristics in a manner 
defined by the user. 

[0002] Effects such as pitch shift, delay, flanging, 
echo, reverberation, equalization or compression have 
been applied to audio analog and digital signals, and 
effects such as color processing have been applied to 
video analog and digital signals, in audio and video sig- 
nal processing. However, each signal has been proc- 
essed in its entirety through each effect, requiring sep- 
arate application of each of a plurality of effects to the 
entire signal, which is very time consuming, expensive 
and inefficient 

[0003] Respective aspects of the invention are set out 

in cidims 1 and 36. 

[00O4] A preferred embodiment of the present inven- 
tion provides a system for processing an input signal so 
ao to enable a plurality of effects to be automatically ap- 
phcd to characteristics of the input signal in a manner 
dolmod by the user. The preferred system includes 
mcrins lor analyzing an input signal so as to generate a 
pljrnlity of characteristics of the input signal. The sys- 
tem lurtner includes means for routing the plurality of 
innut signal characteristics, connected to the analyzing 
means, programmable bythe user, to enable each input 
signal characteristic to be automatically routed to such 
oi the plurality of effects as defined by the user. 
[0005] The preferred embodiment provides a system 
which is capable of analyzing the dynamics of a signal 
to generate signal characteristics, and applying select- 
ed ones of a plurality of effects to each signal charac- 
teristic, automatically in a manner defined by the user, 
for separate parallel processing of signal characteris- 
tics 

[0006] The preferred system generates a plurality of 
characteristics of an input signal, so as to enable effects 
processing of each characteristic and enables the user 
to detine which effects are to be applied to each signal 
characteristic. The signal characteristics are automati- 
cally routed to the effects as defined by the user. 
[0007] The invention will now be described by way of 
example with teference to the accompanying drawings, 
thioughout which like parts are referred to by like refer- 
ences, and in which: 

FIG. 1 is a schematic diagram illustrating an effects 
processing system in accordance with one embod- 
iment of the present invention; 
FIG. 2 is a block diagram of an effects processing 
system in accordance with another embodiment of 
the present invention; 

FIG. 3 is a block diagram of the manner in which 



musical notes are processed through a previously 
proposed processing system; and 
FIG. 4 is a block diagram of the manner in which 
musical notes are processed through an effects 
5 processing system embodying the present inven- 

tion. 

[0008] Referring now to the drawings, and in particu- 
lar to FIGURES 1 and 2, there is shown a system 10 for 

10 processing an input signal 12 to enable a plurality of ef- 
fects to be automatically applied thereto. The input sig- 
nal 1 2 may comprise an analog or digital audio or video 
signal. Where the input signal 12 comprises an analog 
audio or video signal, the system 1 0 may further include 

15 an analog-to-digita! converter 14 for converting the an- 
alog input signal into a digital signal for processing. The 
effects to be applied to the input signal 12 comprise ef- 
fects applicable to the signal dynamics, and may com- 
prise for example pitch shift, delay, flanging, echo, re- 

20 verberation, equalization, or compression for an audio 
signal, and may include for example color processing 
for a video signal. 

[0009] System 10 includes an interface 16 for ena- 
bling a signal to be input therein, and elements 18 and 

25 20 for analyzing the dynamics of input signal 12. For an 
audio input signal, analyzing element 18 may comprise 
a band pass filter bank, which is programmable, for an- 
alyzing and filtering the spectrum of frequencies in the 
input signal, connected to interface 16 so as to analyze 

30 the input signal dynamics and generate input signal 
characteristics. Analyzing element 20 for the audio input 
signal may comprise an amplitude detector, for analyz- 
ing and detecting the amplitudes in the input signal as- 
sociated with the signal frequencies, connected to filter 

35 bank 18 so as to further analyze input signal dynamics 
and further generate input signal characteristics. The 
audio input signal may include signal dynamics which 
may comprise for example midi time code position point- 
ers, which may be analyzed by analyzing element 1 8 to 

40 generate input signal characteristics for effects process- 
ing. For a video input signal, the signal dynamics to be 
analyzed may comprise for example the spectrum of 
colors in the signal so as to generate input signal char- 
acteristics for effects processing which may include 

45 color correction. 

[0010] System 10 may further include elements 22 for 
generating the plurality of effects applicable to signal dy- 
namics, which element 22 may be internal to system 10 
as shown, or external and adapted to be connected to 

50 system 10. 

[0011] System 10 may also include a routing element 
24, programmable by the user, for routing the plurality 
of input signal characteristics to the effects in effects 
generator 22 in the manner def in ed by the user. Routing 

55 element 24 may comprise an intelligent router, and may 
be connected to filter bank 18, amplitude detector 20, 
and effects generator 22. Each input signal characteris- 
tic may be automatically directed by router 24 to one or 
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more of the effects in effects generator 22, in the manner 
defined by the user. 

[0012] System 1 0 may still further include a control el- 
ement 26, which may be synchronized and externally 
connectable to system 10, for controlling operation of 
programmable routing element 24 and programmable 
analyzing element 1 8 to which control element 26 is con- 
nected. Control element 26 may control routing element 
24 and analyzing element 18 through pulses such as 
midi time code for an audio signal, time code for a video 
signal, or frequency band. 

[001 3] System 1 0 may also include an element 26, for 
combining the processed characteristics into an output 
signal 34. Where the processed signal comprises a dig- 
ital audio or video signal converted from an analog sig- 
nal in analog-to-digital converter 14, system 10 may also 
include a digital-to-analog converter 30 for converting 
the digital processed signal to an analog output signal. 
[0014] System 10 may still further include an element 
32 for enabling a characteristic or characteristics of the 
input signal to bypass routing element 24, for side chain 
processing to bypass routing element 24 and separately 
apply effects thereto other than those in effects gener- 
ator 22 or not to apply any effects thereto, to be then 
combined in combining element 28 as part of output sig- 
nal 34. 

[0015] In a prior art processing system as shown in 
FIG. 3, a chord 36 which includes musical notes such 
as "C. E and G" may be analyzed as a unit in analyzer 
36 to generate signal dynamics, and processed as a unit 
in through an effects processor 40 to generate an effects 
processed output 42. In a processing system of the 
present invention as shown in FIG. 4, the musical notes 
44 in chord 36 are each separately analyzed in analyz- 
ing elements 18 and 20 to generate separate notes 44 
based on signal dynamics, and each note 44 is sepa- 
rately routed to the plurality of effects 46 automatically 
in the manner defined by the user, and then recombined 
into the effects processed output signal. 
[0016] In operation, an input signal 12 may be input 
to system 10 at interface 16. For example, where input 
signal 12 is an analog signal, it may then be converted 
to a digital signal in analog-to-digital converter 14. The 
signal dynamics may then be analyzed in analyzing el- 
ements 18 and 20 so as to generate a plurality of char- 
acteristics to be processed. For example, for an audio 
input signal, the audio spectrum may be analyzed in pro- 
grammable band pass filLer bank 18, which analyzes 
and filters the spectrum of audio frequencies, and in am- 
plitude detector 20, which analyzes and detects audio 
signal amplitudes, so as to generate the plurality of char- 
acteristics to be processed. Control element 26 may 
control the analyzing in filter bank 18. Where the audio 
input signal includes midi time code position pointers, 
analyzing element 18 may analyze the pointers to gen- 
erate the plurality of characteristics to be processed. 
Where the input signal comprises an analog audio sig- 
nal, the analog audio input signal may be converted into 



a digital signal in analog-to-digital converter 14 for fur- 
therprocessing Where the input signal comprises a vid- 
eo input signal, the signal dynamics to be analyzed may 
comprise the color spectrum, and analyzing element 18 

5 may analyze the spectrum of colors so as to generate 
the plurality of characteristics to be processed. 
[0017] The input signal characteristics may then each 
be automatically routed through programmable routing 
element 24 to such of the plurality of effects, applicable 

to to signal dynamics and generated in effects generator 
22, as the user may define. The user may define in con- 
trolling element 26 the effects to which each input signal 
characteristic is directed in intelligent router 24, which 
controlling element 26 may also control the filtering of 

is signal frequencies into signal characteristic in analyzing 
element 18. Controlling element 26 may generate con- 
trol pulses which may be midi time code based for an 
audio signal, may be time code based for a video signal, 
or may be frequency based. For example, for an audio' 

20 input signal a signal characteristic may be directed to 
effects such as pitch shift, delay, flanging, echo, rever- 
beration, equalization, and/or compression, and a video 
input signal may be directed to effects including color 
processing. 

25 [0018] An input signal characteristic or characteristics 
may be directed in bypassing element 32 so as to be 
side chain processed separately from characteristics di- 
rected in routing element 24 to effects generator 22, for 
applying separate effects thereto or for not applying any 

30 effects thereto 

[0019] The effects processed characteristics and any 
side chain processed characteristics may then be com- 
bined in combining element 28 so as to generate an out- 
put signal. Where the processed signal is a converted 

35 digital signal, it may be converted to an analog signal in 
digital to analog converter-30 to generate an analog out- 
put signal. 

[0020] From the foregoing it will be appreciated that 
the system of the present invention provides advantag- 

40 es in selectively processing each of a plurality of input 
signal characteristics, generated by analyzing the input 
signal dynamics, through effects in a user-defined man- 
ner, to automatically generate an effects processed out- 
put signal. While particular forms of the invention have 

45 been illustrated and described, it will be apparent that 
various modifications can be made without departing 
from the scope of the invention. Accordingly, the inven- 
tion is not to be limited, except as by the following claims. 



1. A system for processing an input signal for enabling 
a plurality of effects to be automatically applied to 
characteristics of the input signal, comprising: 

means for analyzing the dynamics of an input 
signal so as to generate a plurality of charac- 
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teristics of the input signal, programmable by 
the user; and 

means for routing the plurality of input signal 
characteristics , connected to the analyzing 
means, programmable by the user to enable 
each input signal characteristic to be automat- 
ically routed to such of the plurality of effects as 
defined by the user. 

2. The system of claim 1 , wherein the input signal dy- 
namics include a plurality of input signal frequen- 
cies, and the analyzing means comprise means for 
analyzing the spectrum of frequencies and filtering 
the plurality of input signal frequencies so as to gen- 
erate the plurality of input signal characteristics. 

3. The system of claim 1 , wherein the input signal dy- 
namics include a plurality of input signal amplitudes, 
and the analyzing means comprise means for ana- 
lyzing the signal amplitudes and delecting the plu- 
rality of input signal amplitudes so as to generate 
the plurality of input signal characteristics. 

4. The system of claim 1 , wherein the input signal dy- 
namics include midi time code position pointers, 
and the analyzing means comprise means for ana- 
lyzing the midi time code position pointers so as to 
generate the plurality of input signal characteristics. 

5. The system of claim 1 , wherein the input signal dy- 
namics include color and the analyzing means com- 
prise means for analyzing the spectrum of color so 
as to generate the plurality of input signal charac- 
teristics. 

6. The system of claim 1 , wherein the routing means 
comprise an intelligent router. 

7. The system of claim 1, further comprising means 
for controlling the routing means, connected to the 
routing means. 

8. The system of claim 1, further comprising means 
for generating the plurality ot effects, connected to 
the routing means. 

9. The system of claim 1, further comprising means 
for enabling an input signal characteristic to bypass 
the routing means for separate side chain process- 
ing of the input signal characteristic, connected to 
the analyzing means. 

1 0. The system of claim 1 , wherein the effects comprise 
pitch shift. 

11. The system of claim 1 , wherein the effects comprise 
delay. 
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12. The system of claim 1, wherein the effects comprise 
flanging 

13. The system of claim 1, wherein the effects comprise 
5 echo. 

14. The system of claim 1 , wherein the effects comprise 
reverberation. 

10 15. The system of claim 1, wherein the effects comprise 
equalization. 

16. The system of claim 1 , wherein the effects comprise 
compression. 

is 

17. The system of claim 1 , wherein the effects comprise 
color processing. 

18. The system of claim 1, wherein the input signal 
20 comprises an audio signal. 

19. The system of claim 1, wherein the input signal 
comprises a video signal. 

2S 20. The system of claim 2, wherein the input signal dy- 
namics further include a plurality of amplitudes, and 
the analyzing means further comprise means for 
detecting the plurality of input signal amplitudes as- 
sociated with the signal frequencies so as to gen- 

30 erate the plurality of input signal characteristics. 

21. The system of claim 7, wherein the controlling 
means are further adapted to control the analyzing 
means. 

35 

22. The system of claim 7, wherein the controlling 
means are adapted to control the routing means 
through control pulses. 

40 23. The system of claim 8, further comprising means 
for combining the processed characteristics into an 
output signal, connected to the effects generating 
means. 

45 24. The system of claim 18, wherein the audio signal 
comprises an analog audio signal. 

25. The system of claim 18, wherein the audio signal 
comprises a digital audio signal. 

so 

26. The system of claim 1 9, wherein the video signal 
comprises an analog video signal. 

27. The system of claim 1 9, wherein the video signal 
5 5 comprises a digital video signal. 

28. The system of claim 22, wherein the control pulses 
are midi time code based. 



EP 0 918 435 A2 



so 



1NSOOCID: <EP 091S435A2_I_> 



7 



EP 0 918 435 A2 



8 



29. The system of claim 22, wherein the control pulses 
are time code based. 

30. The system of claim 22, wherein the control pulses 
are frequency based s 

31. The system of claim 23, further comprising means 
for enabling an input signal characteristic to bypass 
the routing means, for separate side chain process- 
ing of the input signal characteristic, connected to io 
the analyzing means, and means for enabling a by- 
passed characteristic to be combined in the com- 
bining means. 

32. The system of claim 24, further comprising means is 
for converting the analog audio input signal into a 
digital audio signal for processing thereof. 

33. The system of claim 26, further comprising means 

for converting the analog video signal into a digital 20 
video signal for processing thereof. 

34. The system of claim 32, further comprising means 
for converting the digital audio signal into an analog 
audio signal after processing thereof. 25 

35. The system of claim 33, further comprising means 
for converting the digital video signal into an analog 
video signal after processing thereof. 

30 

36. A method of processing an input signal for enabling 
a plurality of effects to be automatically applied to 
characteristics of the input signal, in a system which 
comprises means for analyzing the dynamics of an 
input signal so as to generate a plurality of charac- 35 
teristics of the input signal, programmable by the 
user, and means for routing the plurality of input sig- 
nal characteristics, connected to the analyzing 
means, programmable by the user, to enable each 
input signal characteristic to be automatically rout- 40 
ed to such of the plurality of effects as defined by 

the user, the method comprising the steps of: 

analyzing the dynamics of an input signal in the 
analyzing means so as to generate the plurality 45 
of characteristics of the input signal; and 
routing the plurality of input signal characteris- 
tics in the routing means so as to enable each 
input signal characteristic to be automatically 
routed to such of the plurality of effects as de- so 
fined by the user. 

37. The method of claim 36, wherein the input signal 
dynamics include a plurality of input signal frequen- 
cies, and the analyzing means comprise means for ss 
analyzing the spectrum of frequencies and filtering 
the plurality of input signal frequencies so as to gen- 
erate the plurality of input signal characteristics, and 



the step of analyzing the input signal dynamics 
comprises filtering the plurality of input signal fre- 
quencies. 

38. The method of claim 36, wherein the input signal 
dynamics includes a plurality of input signal ampli- 
tudes, and the analyzing means comprise means 
for analyzing the signal amplitudes and detecting 
the plurality of input signal amplitudes so as to gen- 
erate the plurality of input signal characteristics, and 
the step of analyzing the input signal dynamics 
comprises detecting the plurality of input signal am- 
plitudes 

39. The method of claim 36, wherein the input signal 
dynamics include a plurality of midi time code posi- 
tion pointers, and the analyzing means comprise 
means for analyzing the midi time code position 
pointers so as to generate the plurality of input sig- 
nal characteristics, and the step of analyzing the in- 
put signal dynamics comprises analyzing the midi 
time code position pointers. 

40. The method of claim 36, wherein the input signal 
dynamics include color and the analyzing means 
comprise means for analyzing the spectrum of color 
so as to generate the plurality of input signal 
characteristics , and the step of analyzing the input 
signal dynamics comprises analyzing the spectrum 
of color. 

41 . The method of claim 36, wherein the routing means 
comprise an intelligent router, and the step of rout- 
ing the plurality of input signal characteristics com- 
prises routing the characteristics in the intelligent 
router. 

42. The method of claim 36, wherein the system further 
comprises means for controlling the routing means, 
connected to the routing means, further comprising 
the step of controlling the routing means in the con- 
trolling means. 

43. The method of claim 36, wherein the system further 
comprises means for generating the plurality of ef- 
fects, connected to the routing means, further com- 
prising the step of generating the effects in the gen- 
erating means. 

44. The method of claim 36, wherein the system further 
comprises means for enabling an input signal char- 
acteristic to bypass the routing means for separate 
side chain processing of the input signal character- 
istic, connected to the analyzing means, further 
comprising the step of enabling an input signal char- 
acteristic to bypass the routing means through the 
bypass enabling means. 
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45. The method of claim 36, wherein the effects com- 
prise pitch shift, and the step of routing the plurality 
of characteristics comprises routing the plurality of 
characteristics through the routing means to the 
pitch shift effect. 

4G. The method of claim 36, wherein the effects com- 
prise delay, and the step of routing the plurality of 
characteristics comprises routing the plurality of 
characteristics through the routing means to the de- 
lay effect. 

47. The method of claim 36, wherein the effects com- 
prise flanging, and the step of routing the plurality 
of characteristics comprises routing the plurality of 
characteristics through the routing means to the 
flanging effect. 

48. The method of claim 36, wherein the effects com- 
prise echo, and the step of routing the plurality of 
characteristics comprises routing the plurality of 
characteristics through the routing means to the 
echo effect. 

49. The method of claim 36, wherein the effects com- 
prise reverberation, and the step of routing the plu- 
rality of characteristics comprises routing the plural- 
ity of characteristics through the routing means to 
the reverberation effect. 

50. The method of claim 36, wherein the effects com- 
prise equalization, and the step of routing the plu- 
rality of characteristics comprises routing the plural- 
ity of characteristics ranges through the routing 
means to the equalization effect. 

51. The method of claim 36, wherein the effects com- 
prise compression, and the step of routing the plu- 
rality of characteristics comprises routing the plural- 
ity of characteristics through the routing means to 
the compression effect. 

52. The method of claim 36, wherein the effects com- 
prise color processing, and the step of routing the 
plurality of characteristics comprises routing the 
plurality of characteristics through the routing 
means to the color processing effect. 

53. The method of claim 36, wherein the input signal 
comprises an audio input signal, and the step ot an- 
alyzing the dynamics comprises analyzing the dy- 
namics of the audio input signal. 

54. The method of claim 36, wherein the input signal 
comprises a video input signal, and the step of an- 
alyzing the dynamics comprises analyzing the dy- 
namics of the vidso input signal. 



55. The method of claim 37, wherein the input signal 
dynamics further include a plurality of amplitudes, 
and the analyzing means further comprise means 
for detecting the plurality of input signal amplitudes 

£ associated with the signal frequencies so as to gen- 
erate the plurality of input signal characteristics, and 
the step of analyzing the dynamics further compris- 
es detecting the plurality of input signal amplitudes 
so as to generate the plurality of input signal char- 

10 acteristics. 

56. The method of claim 42 wherein the controlling 
means are further adapted to control the analyzing 
means, further comprising the step of controlling the 

15 analyzing means in the controlling means. 

57. The method ot claim 42, wherein the controlling 
means are adapted to control the routing means 
through control pulses, and the step of controlling 

20 the routing means comprises controlling the routing 
means through the control pulses. 

58. The method of claim 43, wherein the system further 
comprises means for combining the processed 

25 characteristics into an output signal, connected to 
the effects generating means, further comprising 
the step of combining the processed characteristics 
into an output signal in the combining means. 

30 59. The method of claim 53, wherein the audio signal 
comprises an analog audio signal, and the step of 
analyzing the dynamics comprises analyzing the 
dynamics of the analog audio signal. 

35 60. The method of claim 53, wherein the audio input sig- 
nal comprises a digital audio signal, and the step of 
analyzing the dynamics comprises analyzing the 
dynamics of the digital audio signal. 

40 61. The method of claim 54, wherein the video signal 
comprises an analog video signal, and the step of 
analyzing the dynamics comprises analyzing the 
dynamics of the analog video signal. 

4 5 62. The method of claim 54, wherein the video signal 
comprises a digital video input signal, and the step 
of analyzing the dynamics comprises analyzing the 
dynamics of the digital video input signal. 

so 63. The method of claim 57, wherein the control pulses 
are midi time code based, and the step of controlling 
the routing means comprises controlling the routing 
means through midi time code based control puls- 
es. 

SB 

64. The method of claim 57, wherein the control pulses 
are time code based, and the step of controlling the 
routing means comprises controlling the routing 
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means through time code based control pulses. 

65. The method of claim 57, wherein the control pulses 
are frequency based, and the step of controlling the 
routing means comprises controlling the routing s 
means through frequency based control pulses. 

66. The method of claim 58, further comprising means 
for enabling an input signal characteristic to bypass 

the routing means for separate side chain process- 10 
ing of the input signal characteristic, connected to 
the analyzing means, and means for enabling a by- 
passed characteristic to be combined in the com- 
bining means, further comprising the steps of ena- 
bling an input signal characteristic to bypass the is 
routing means in the bypass enabling means, and 
enabling the bypassed characteristic to be com- 
bined into the output signal in the combining means 

67. The method of claim 59, wherein the system further 20 
comprises means for converting the analog audio 
signal into a digital audio signal for processing 
thereof, further comprising the step of converting 

the analog audio signal into a digital audio signal in 
the analog audio signal converting means. 25 

68. The method of claim 61 , wherein the system further 
comprises means for converting the analog video 
signal into a digital video signal for processing 
thereof, further comprising the step of converting 30 
the analog video signal into a digitaf video signal for 
processing thereof in the analog video converting 
means. 

69. The method of claim 67, wherein the system further 35 
comprises means for converting the digital audio 
signal into an analog audio signal after processing 
thereof, further comprising the step of converting 

the digital audio signal into an analog audio signal 

in the digital audio signal converting means. 40 

70. The method of claim 68, wherein the system further 
comprises means for converting the digital video 
signal into an analog video signal after processing 
thereof, further comprising the step of converting 45 
the digital video signal into an analog video signal 

in the digital video signal converting means 



so 
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Systems and methods for processing audio or video effects 



(57) A system (10) for processing an input signal 
(12) can automatically apply a plurality of effects (22) 
thereto in a user-defined manner. The dynamics of the 
input signal (12) are analyzed (18,20) so as to generate 



a plurality of signal characteristics. Each signal charac- 
teristic is processed through a plurality of effects (22) in 
a manner controlled by the user so as to be routed (24) 
automatically to such of the effects (22) in the plurality 
of effects as the user defines. 
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